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Optical  Fingerprint  Identification  by 
Binary  Joint  Transform  Correlation 


1,  INTRODUCTION 


The  purpose  oi  research  efforts  In  optical  signal  processing  is  to  develop  techniques  leading 
to  systems  that  optically  process  data  at  very  high  rates  of  speed,  preferably  with  smaller 
volume  and  lower  power  requirements.  Image  processing  systems  based  on  the  Joint  Fourier 
transform  technique'  (JTC)  have  been  shown  to  have  good  performance. ^  ^  Binarizing  the 

joint  power  spectrum  (JPS)  of  the  JTC  provides  significantly  higher  peak  Intensity,  larger 


(Received  for  publication  15  February  1991) 

’  Weaver,  C.S.  and  Goodman,  J.W.  (1966)  A  technique  for  optically  convolving  two  functions, 
AppL  Opt  5:1248. 

2  Yu.  F.T.S..  Jutamulla,  S.,  Lin,  T.W.,  and  Gregory,  D.A.  (1984)  Adaptive  real-time  pattern 
recognition  using  a  liquid  crystal  TV  based  Joint  tremsform  correlator,  Appi  Opt.  26:1370. 

3  Florence.  J.  (1989)  Joint-transform  correlator  systems  using  deformable-mirror  spatial 
light  modulators.  Opt.  Lett.  14:341. 

*  Javldl.  B.  and  Homer,  J.L.  (1989)  Multifunction  nonlinear  signal  processor:  deconvolution 
and  correlation,  Opi.  Lng.  28:837. 

^  Tam,  E.D.,  Yu.  F.T.S.,  Gregory,  D.A.,  and  Juday,  R.D.  (1990)  Autonomous  real-time  object 
tracking  wltfj  an  adaptive  Joint  transform  correlator.  Opt.  Eng.  29:314. 
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peak-to-secondary  ratios,  della-like  c  orrelations,  and  better  cross-con  elation  discrimination.'’ 
We  present  a  system  using  a  prism  operating  In  the  total  Internal  reflec  tion  mode  to  optically 
generate  a  high  contrast  Image  ol  a  llngerprlnl^  '^  lhat  Is  used  as  an  Input  to  the  bmary  JTC 
(BJTC)  for  comparison  with  a  data  base.  This  compact  system  operates  In  near  real-time,  and 
has  good  discrimination  capability.  While  this  system  Is  Ideally  suited  for  secure  entry 
systems  to  idenUly  Individuals  for  access  to  a  restricted  area,  It  could  be  used  for  mobile  and 
ren.ote  su*  .eiliaiic.e  law  eriorcemenl  agencies. 


2.  THEORY 

2.1  Prism  -  Total  Internal  Reflection 


High  contrast  images  of  a  fmgerprlnt  can  be  read  optically  using  a  standard  90  degree 
prism  where  tlie  read  beam  Is  directed  at  the  critical  angle. ^  ^  When  the  laser  beam  enters  one 
side  of  a  90  degree  prism  and  strikes  the  hypotenuse  at  an  angle  given  by 


0 

C 


=  arcsm 


(1) 


the  transmitted  light  will  travel  tangentially  to  the  glass  medium  mterface.  Incident  angles 
beyond  6(_  will  cause  the  light  to  be  totally  Internally  reflected  In  the  prism  and  pass  out  the 
opposing  side.  This  assumes  (pi  >  nj)  where  r|i  ’It  the  mdlces  of  refraction  of  the  prism 
glass  and  external  medium. 

Placing  a  finger  on  the  hypotenuse  side  of  the  prism,  shown  In  Figure  la,  changes  the 
boundary'  conditions:  so  that  where  ridges  of  the  fingerprint  make  contact  with  the  glass,  the 
natural  oils  of  the  skin  make  a  good  optical  bond  and  the  light  wave  Is  transmitted  emd  largely 
attenuated  by  the  skin.  Where  lire  ridges  don't  make  contact  the  light  Is  totally  Internally 
reflected  by  the  Interface  and  captured  by  the  Input  camera.  An  example  of  the  captured  print 
Is  shown  In  Figure  lb.  Figure  Ic  shows  the  print  binarized  around  Its  mean  value.  This  print 
Is  sent  to  the  BJTC  for  comparison  with  a  database  of  fingerprints  to  determine  the 
Individual  s  identity. 

^  Javidl.  B.  and  Kuo.  C.  (1988)  Joint  transform  Image  correlation  using  a  binary  spatial  light 
modulator  at  the  Fourier  plane,  Appl  Opt.  27:663. 

^  Shimizu,  A.  and  Hase.  M.  (1984)  Entry  method  of  fingerprint  Image  using  prism,  Trans. 

Inst.  Electron,  and  Comman.  Engineers  of  Japan  Part  D.  J67D(no  5):627. 

®  Gerhardt,  L.A.,  AttUl.  J.B.,  Crockett.  D.H.,  and  Presler,  A.M.  (1986)  Fingerprint  Imagery 
using  frustrated  total  Internal  reflection.  Proceedings  of  the  1986  International  Carnahan 
Conference  on  Securily  Tecimology,  251. 
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Figure  1 .  a)  An  Exaggerated  View  of  the  Finger  In  Contact  with  the  Prism, 
b)  a  Typical  Fbigerprlnt  Image,  c)  the  Fingerprint  Binarized  Around  Its  Mean 
Value. 


Ic 


2.2  Binary  Joint  Transform  Correlator 


For  the  JTC  aiThllecture  shown  In  FtfJure  2.  the  relfrenee  and  target  Iniatje  are  |)la('ed  on 
their  respective  tialves  ol  111  *  Input  spatial  lljihl  niodnlalor  (SLM)  and  are  denf)led  t)v  rlx  +  x,,.  v) 
anci  s(x  -  x^.y).  The  Fonrier  transform  of  this  input,  ealleil  the  )otnt  power  speririiin  I  JPS),  is 
captured  ny  a  square  law  detector  and  Fourier  transformed.  It  t  an  be  shown  that  tlie  resulting 
correlation  signals  are  given  hy 


•  y  1 )  =  1 )  +  >'i )  + 


.(^-2vv,) 


lesv  1 


+  R,, 


s  u 


(2) 


BEAM  REFERENCE  BEAM 


Figure  2.  Compact  1-f  Correlator  Configuration, 


The  first  two  terms  are  on-axls  auloconelallon  terms,  the  ctjnelallon  of  reference  and 
target  signals  with  themselves,  and  the  Uilrd  and  fourth  terms  are  the  correlations  of  Uie 
reference  with  the  target. 

Javldl  was  the  first  to  binarize  the  Joint  power  spectrum®  (JPS)  and  formalized  the  kth  law 
nonlinearity  revealing  an  Interesting  family  of  correlation  types  varying  In  sensitivity.^ 
Although  our  work  Is  perfoinied  using  a  binary  SLM.  Uie  full  potential  of  the  fingerprint 

^  Javldl.  B.  (1989)  Nonlinear  joint  power  spectrum  based  optical  correlation,  Appl.  Opt. 
28:2358. 


coiTf'lator  should  l)t*  reall/od  iislni;  a  f>rayscale  device.  By  applylii^>  a  noidlnear  operalioii  on 
JPS  and  lo  lowing  the  theoretical  development  ol  Relerence  9,  we  llnd  the  output  field  of  tfie 
nonllneaj-  system  Is  made  up  of  harmonics  with  tlie  flist  term  containing  the  correct  phase 
Information  and  largest  Intensity.  The  general  eijuatJon  for  tills  first  hannonlc  Is  given  by  ’ 


Ik' 


2r(k^1)(R(o,(i)S(a,lf))'' 

vi  1-^“^  'r( 

2  y  2  ' 


cos  (2x,.,a  +  0^(a,li)  -  0,^(n.li))  ■ 


(3) 


If)  belter  understand  the  nonlinear  process,  let  us  vary  k  and  compare  the  field  In  Eq.  (3)  to 
the  held  e.fitlng  tlie  filter  of  a  frequency  olane  correlator.’’  Assuming  Uie  target  and 
relerence  are  Identical  and  letting  k  =  1,  Eq.  (3)  reduces  ‘o  the  field  one  expects  to  leave  the 
Fourier  plane  of  a  frequency’  plane  f  orrelator  einploy’lng  a  classical  matched  filter.  If  k  =  0.5. 
the  held  is  similar  to  a  phase-only  filter  based  correlator:  and  if  k  =  0.  the  hardcllp 
blnarl/atlon  we  use  here,  tlie  analogy  is  to  the  inverse  filter  correlator  since  all  amplitude 
inlormallf)!!  of  both  the  Input  and  leference  signals  have  been  eliminated.  These  fillers  aie 
suf  f  esslvely  more  sensttU’e  to  Input  object  distortions,  so  by  varying  the  nonlinearity,  k.  Uie 
sensitivity  of  the  system  to  target  Image  dlstorations  can  be  changed.  We  feel  tills  concept  of 
vaiying  the  sensitivity  Is  extremely  important  In  this  system.  It  Is  probably  not  Ideal  to 
compare  Images  at  eltlier  extreme  of  the  scale  presented  here.  If  k  =  1.  the  system  Is  likely'  to 
be  taliiy  insensitive  and  false  alarms  will  occur,  while  If  k  =  0  the  system  will  be  too  sensitive. 
re'|ulring  die  target  print  to  be  extremely  similar  to  the  reference  for  correct  Identification,  in 
the  next  section  we  describe  our  exijertmental  results  comparing  fingerprints  from  several 
Indhiduals.  We  have  successlully  Identified  Individuals  using  a  system  ernijloying  a  binary’ 
SI.M.  eiK  niiiaglng  us  to  pursue  this  research  wlHi  a  grayscale  device. 


3.  EXPERIMENTAL  METHOD  AND  RESULTS 


The  ( firnpaci  oiitlcal  BJTC  system  Is  siiown  In  Figure  2.  A  lOrnW  He-Ne  laser  Is  the  source 
and  (he  SLM  u.sed  Is  the  SEMETEX  128x128  binary’  electrically  addressed  device.  A  liC  blo(  k  Is 
used  In  the  Fourier  plane  to  more  accurately  capture  the  JPS.'”  We  have  previously  show’ll  that 
tlie  correlation  peak  Intensity  can  Increase  by  a  factor  of  2  using  Uie  DC  block.  The 
flngeqrrlnts  of  5  Individuals  were  compared  to  evaluate  the  effectiveness  of  this  system.  Two 
dlsilnr  t  flngeririints  from  liie  ligiit-hand  Index  finger  of  each  Individual  are  obtained  and 
stored  In  the  romputer  In  128.xl28  data  files.  Ea<ii  flngciqirlnt  Is  compared  with  all  other 


Fielding,  K.H.  and  Homer,  J.L,  (1990)  1  f  Binary  Joint  Transform  Correlator,  RADC-TR-90- 
201. 


6 


fingerprints  in  the  data  base.  The  two  fingerprint  Images  to  be  compared  are  separately 
binarized  around  their  respective  average  value  and  reduced  to  64x64  images  that  are  placed 
together  on  the  SLM.  The  JPS  is  captured  by  a  CCD  camera  and  binarized  around  Its  average 
value.  Tlie  binarized  JPS  is  displayed  on  the  SLM,  and  the  resulting  correlation  observed. 
Fable  1  r.hows  the  results.  A  +  sign  indicates  a  proper  Identiflcatlon,  while  a  -  sign  indicates  a 
correct  ho  match"  response.  The  Indication  was  simply  the  presence  or  lack  of  a  clear  and 
distinct  correlation  peak.  In  our  limited  trials  we  iiad  no  false  alarms.  We  should  mention 
that  a  guide  was  fashioned  on  the  prism  to  help  the  individuals  place  their  finger  in  the  same 
orientation  for  each  measurement.  This  Is  essential  when  dealing  with  the  sensitive  BJTC. 


Table  1.  Results  of  the  Fingerprint  Ccmparison  Trails 


Fingerprint 

FIA 

F2A 

F3A 

F4A 

F5A 

FIP 

+ 

- 

- 

- 

r2B 

- 

+ 

- 

- 

- 

F3D 

- 

- 

-1- 

* 

- 

F4B 

- 

* 

_ 

+ 

- 

F5B 

- 

- 

- 

- 

+ 

Figure  3a  shows  the  binarized  fingerprints  of  an  individual  placed  on  the  SLM.  The  print 
on  the  left  la  the  stored  reference  while  the  fingerprint  on  the  right  Is  optically  read  and  fed 
into  the  system.  The  binarized  JPS  of  this  input  Is  shown  m  Figure  3b  with  the  corresp>ondlng 
correlation  shown  in  Figure  3c.  The  coi;elatlons  nearest  the  DC  block  are  fi-om  the  zeroth 
order  while  the  outside  correlations  are  from  the  first  replicated  orders.  The  peak-to- 
secondary  ratio  of  the  correlation  is  3-to-l  while  the  signal- to-nolse  ratio  (SNR)  is  27  using  the 
metric'® 


SNR  =  - 
N 


RMS 


(4) 


where  Cq  and  are  the  peak  height  and  RMS  of  the  .lOlse  in  the  correlation  plane  whose 

mean  has  been  subtracted  out.  To  simplify  the  calculation,  we  considered  all  points  except  the 
coiTelation  peak  as  noise.  The  typical  peak  is  only  a  few  pixels  wide  at  its  base  so  counting 
dtese  points  as  noise  does  not  appreciably  affect  the  calculation. 
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3a 


Figure  3.  a)  Binarized  Reference  and  Target  Print  Placed  on  the  SLM, 

b)  the  Joint  Power  Spectrum  Binarized  Around  the  Mean  Value, 

c)  the  Resulting  Correlations. 
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In  attempting  to  reduce  the  sensitivity  of  the  BJTC  we  tried  a  new  approach:  we  applied  a 
kth  law  nonlinearity  on  the  JPS  before  binarizing.  Raising  the  JPS  to  powers  greater  than 
unity  should  accentuate  the  lower,  more  intense,  spatial  ftequencles  while  suppressing  higher 
ones  yielding  less  sensitivity  In  the  correlation  plane.  Computer  simulations  showed  a  peak 
In  the  SNR  as  k  was  varied,  but  it  was  improved  by  only  a  few  percent.  Further  Investigation 
of  this  approach  Is  imderway. 


4.  CONCLUSIONS 


We  have  experimentally  demonstrated  a  simple  system  that  optically  reads  a  fingerprint 
and  optlcaUy  compares  It  with  a  database  for  Identification  purposes.  We  have  combined  the 
previously  demonstrated  method  of  reading  the  fingerprint  using  a  prism  with  the  binary  JTC 
technique  for  correlating  reference  and  target  images.  The  hybrid  optlcal/dlgital  system  uses  a 
PC  to  store  the  reference  database  and  control  the  electrically  addressed  SLM.  This  system 
operates  well  using  the  binary  SLM  and  we  had  no  false  alarms  In  our  trials.  Using  a 
grayscale  SLM  would  unlock  the  full  potential  of  this  system  permitting  one  to  vary  the 
sensitivity  of  this  system  to  enhance  performance. 
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